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Abstract 


riiis  paper  presents  an  algoritliin  for  finding  parallel  eliininalion  orderings  for 
Gaussian  elimination.  Viewing  a  system  of  equations  as  a  graph,  the  algorithm 
can  be  applied  directly  to  interval  graphs  and  chordal  graphs.  For  general 
graphs,  the  algorithm  can  be  used  to  paralleliise  the  ordering  produced  by  some 
other  heuristic  such  as  minimum  degree.  In  this  case,  the  algorithm  is  applied 
to  the  chordal  completion  that  the  heuristic  generates  from  the  input  graph, 
in  general,  the  input  to  the  algorithm  is  a  chordal  graph  G  with  n  nodes  and 
m  edges,  'i’he  algorithm  produces  an  ordering  with  height  at  most  0(log^  n) 
times  optimal,  fill  at  most  0(m).  and  work  at  most  0[W''(G)),  where  W’'(G)  is 
the  minimum  possible  work  over  all  elimination  orderings  for  G,  Experimental 
results  show  that  when  applied  after  some  other  heuristic,  the  increase  in  work 
and  fill  is  usually  small.  In  some  instances  the  algorithm  obtains  an  ordering 
that  is  actually  better,  in  terms  of  work  and  fill,  than  the  original  one.  VVe 
also  present  an  algorithm  that  produces  an  ordering  with  a  factor  of  log  w  less 
height,  but  with  a  factor  of  0{^/log  n)  more  fill. 


1  Introduction 


One  of  llie  iriobl  popular  irielliods  for  solving  a  system  of  linear  equations  is 
Gausaian  tlirninalion.  riie  crux  of  this  method  is  to  pivot  on  the  variables  of 
the  system  one-at-a-time  according  to  some  ordering.  For  example,  suppose 
that  the  variables  are  to  be  eliminated  according  to  an  ordering  tt. 

Then  in  the  iih  pivoting  step,  variable  is  eliminated  from  equations  7r(/  + 
l),jr(»  +  2),...,7r(rt). 

The  system  of  equations  is  typically  represented  as  a  matrix,  and  as  the 
pivots  are  performed  some  entries  in  the  matrix  that  were  originally  zero  may 
become  non-zero.  I'lie  number  of  new  non-zeros  produced  in  solving  the  system 
is  called  the  fill.  Among  the  many  dilferent  orderings  of  the  variables,  one 
is  typically  chosen  so  as  to  minimize  the  fill.  Minimizing  the  fill  is  desirable 
because  it  limits  the  amount  of  storage  needed  to  solve  the  problem,  and  also 
because  the  fill  is  strongly  correlated  with  the  total  number  of  operations  (work) 
performed. 

Gaussian  elimination  can  also  be  viewed  as  an  algorithm  that  is  performed 
on  the  graph  whose  adjacency  matrix  is  the  matrix  representing  the  system  of 
equations  [29.  31].  Pivoting  on  a  variable  corresponds  to  removing  a  vertex 
from  the  graph  and  forniing  a  clique  of  its  neighbors.  T'he  number  of  new  edges 
added  to  the  graph  in  this  process  constitutes  the  fill.  Throughout  this  paper 
we  assume  that  our  matrices  are  symmetric  positive  definite,  so  that  our  graphs 
are  undirected,  our  pivots  are  always  non-zero,  and  we  can  ignore  the  issue  of 
numerical  stability. 


1,1  Heuristics  for  sparse  Gaussian  elimination 

A  number  of  heuristics  for  minimizing  fill  for  sparse  matrices  are  available,  the 
most  popular  being  nested  dissection  and  minimum-degree. 

Nested  dissection,  as  the  name  suggests,  is  a  recursive  elimination  procedure. 
It  identifies  a  balanced  separator  in  the  graph  and  sets  the  nodes  in  the  separator 
apart  for  elimination  at  the  very  end.  The  components  resulting  from  removing 
the  separator  are  recursively  ordered,  one  after  the  other,  and  placed  before  the 
separator  in  the  elimination  ordering.  George  [12]  first  proposed  this  method 
for  eliminating  nodes  in  a  mesh,  and  later  generalized  it  in  a  paper  with  Liu  [13] 
for  eliminating  the  nodes  in  an  arbitrary  graph.  Bounds  on  the  fill  produced  by 
nested  dissection  orderings  are  known  for  planar  graphs  and  arbitrary  graphs 
with  bounded  degree  [1,  14,  21]. 

The  rninirnum- degree  heuristic  repeatedly  finds  a  vertex  of  minimum  degree 
and  eliminates  it.  This  heuristic  originated  with  the  work  of  Markowitz  in  the 
late  go’s  and  has  undergone  several  enhancements  in  the  years  since  [23].  Its 
popularity  is  attested  to  by  its  inclusion  in  various  publicly  available  codes  sudi 
as  MA28.  YALBSMP,  and  SPAHSPAK.  In  contrast  to  nested  dissection,  no 
performance  guarantee  is  known  for  the  fill  produced  by  this  heuristic,  la  fact, 
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there  exist  graphs  for  which  the  fill  induced  by  tlie  iiiiniiimiu-degree  ordering 
can  be  very  high  [4], 

Recently,  some  hybrid  algorithms  have  been  shown  to  experimentally  pro¬ 
duce  fill  that  compares  favorably  with  those  produced  by  either  minimum-degree 
or  nested  dissection  alone.  Hendrickson  and  Hothberg  [15].  and  independently 
Liu  and  Ashcraft  [2],  proposed  algorithms  that  first  find  separators  that  parti¬ 
tion  the  graph  into  small  components.  I'lie  minimum-degree  heuristic  is  then 
used  to  order  the  vertices  within  each  component,  and  also  within  the  separa¬ 
tors.  In  practice,  both  algorithms  produce  orderings  that  compare  favorably 
with  state-of-the-art  minimum-degree  and  nested-dissection  algorithms,  but  jio 
bounds  on  the  amount  of  fill  that  they  introduce  are  known. 

1.2  Our  results 

In  this  paper  we  focus  on  elimination  orderings  for  chordal  graphs.  Chordal 
graphs  are  a  natural  choice,  because  they  are  rich  in  structure  and  because 
they  are  intimately  related  to  Gaussian  elimination  orderings;  in  fact,  chordal 
graphs  are  exactly  the  class  of  graphs  that  have  ziero-fill  elimination  orderings. 
Moreover,  since  any  elimination  ordering  constructs  a  chordal  completioji  of  a 
graph,  that  is.  adds  edges  to  the  graph  so  as  to  make  it  chordal,  we  can  apply  our 
algorithm  to  the  chordal  completion  produced  by  any  good  ordering  algorithm. 

Chordal  graphs  already  have  zero-fill  eliminatioii  orderings,  so  how  can  we 
possibly  improve  on  that?  We  propose  that  some  extra  fill  might  be  tolerable, 
if  parallelism  can  be  exposed.  Although  we  have  thus  far  described  Gaussian 
elimination  as  if  vertices  were  eliminated  one-at-a-time,  in  fact  a  set  of  vertices 
can  be  eliminated  in  parallel  if  they  are  independent,  i.e..  iio  two  vertices  in  the 
set  are  neighbors,  rims,  in  a  parallel  elimination  ordering,  we  allow  independent 
sets  to  be  eliminated  in  one  step,  and  we  define  the  height  to  be  the  total  number 
of  steps.  A  lower  bound  on  the  height  of  any  elimination  ordering  is  the  size 
of  the  maximum  clique  in  the  graph,  since  the  vertices  in  a  clique  cannot  be 
eliminated  in  parallel. 

Although  a  strictly  sequential  ordering  has  height  n.  it  is  often  possible  to 
expose  some  parallelism  in  a  sequential  ordering.  The  idea  is  to  view  a  sequential 
ordering  as  a  partial  ordering  that  constrains  each  vertex  to  be  eliminated  before 
any  of  its  neighbors  that  appear  later  in  the  sequential  ordering,  rhus,  we  can 
define  the  height  of  a  sequential  ordering  to  be  the  minimum-height  parallel 
ordering  that  is  consistent  with  the  partial  order.  Nested  dissection  is  known 
to  produce  low-height  orderings,  in  particular,  within  a  polylogaiithmic  factor 
of  the  minimum  possible  [1.  28].  On  the  other  hand,  minimum-degree  orderings 
can  have  a  polynomial  factor  more  height  than  the  minimum  possible  (e.g.,  a 
path). 

Trying  to  achieve  fast  parallel  solutions  while  keeping  the  space  overhead 
minimal  corresponds  to  finding  an  ordering  that  has  simultaneously  low  height 
and  low  fill.  Gilbert  conjectured  the  existence  of  a  parallel  elimination  ordering 
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tlial  lias  the  iiiiiiimum  possible  height  among  all  orderings  and  Jill  that  is  only 
a  constant  factor  more  than  the  number  of  edges  in  a  minimum-fill  ordering 
(see  [3]).  The  hope  was  that  a  small  increase  in  fill  could  be  traded  for  faster 
parallel  solutions.  Aspvall  [3]  disproved  this  conjecture,  however,  by  exhibiting 
a  graph  for  which  any  ordering  that  has  the  minimum  possible  height  requires 
a  polynomial  factor  more  fill  than  the  minimum  possible. 

Given  an  interval  graph  (a  subclass  of  chordal  graphs)  with  n  vertices  and  m 
edges,  can  we  find  an  ordering  with  0(m)  fill  and  height  close  to  the  minimum 
possible?  In  particular,  does  a  jiested  dissection  ordering  accomplish  this?  VVe 
show  that  the  classical  nested  dissection  procedure  applied  to  interval  graphs 
produces  an  ordering  with  0{\/logn  •  m)  fill  and  with  height  at  most  O(log  n) 
times  the  optimum  for  that  graph.  In  fact,  the  bound  on  fill  is  tight  if  the 
nested  dissection  algorithm  is  forced  to  choose  a  (l/2)-balanced  separator,  thus 
providing  a  negative  answer  to  our  question.  Even  in  this  very  restricted  class 
of  graphs,  nested  dissection  may  generate  undesirable  fill. 

On  the  positive  side,  we  show  that  an  extension  of  nested  dissection  provides 
good  orderings.  VVe  exliibit  an  interval  graph  algorithm  that  produces  orderings 
with  0(fn)  fill  and  height  within  a  factor  of  (^(log*^  n)  times  the  optimum.  ‘This 
same  algorithm  can  then  be  generalized  to  chordal  graphs,  and  produces  order¬ 
ings  that  also  have  0[ni)  fill,  while  having  height  within  an  0(log^  7i.)  factor  of 
the  minimum  possible.  While  this  guarantee  is  worse  in  terms  of  height  than 
the  one  nested  dissection  provides,  it  is  significantly  better  than  that  given  by 
either  a  perfect  elimination  ordering  or  by  the  minimum-degree  heuristic.  In 
addition  to  the  balanced  separators  used  in  iiested  dissection,  we  utilize  another 
kind  of  separator  that  we  call  stjUintls.  Sentinels  help  localize  the  fill  produced 
by  our  orderings  without  increasing  the  height  by  much.  In  addition  to  the 
bound  on  the  fill,  we  also  show  that  the  total  work  as  well  as  the  front  size^  of 
our  orderings  are  within  a  constant  factor  of  the  minimum  possible. 

Preliminary  experiments  show  that  the  overheads  in  fill  and  height  are  much 
better  than  predicted  by  our  theoretical  analysis.  For  instance,  we  observed 
the  following  interesting  behavior  in  two-dimensional  grids.  Minimum-degree 
performs  better  than  nested  dissection  in  terms  of  fill  and  work  on  grids  with 
high  aspect  ratio  [2].  However,  the  orderings  produced  by  minimum-degree  are 
very  sequential  in  nature  and  exliibit  large  height.  Our  algorithm,  applied  to 
the  chordal  completion  obtained  from  the  minimum-degree  ordering  generates 
an  ordering  that  has  good  height  and  low  fill  and  work,  in  fact,  when  compared 
to  a  nested  dissection  ordering  of  the  original  grid,  our  ordering  exhibits  worse 
height,  but  slightly  better  fill  and  work  (See  Fable  2). 

^  I’he  front  size  corresponds  roughly  to  the  size  of  a  inaximum  clique  in  the  filled  graph. 
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1.3  Related  work:  Fill 


riie  problem  of  fiiidiiig  an  elimination  ordering  that  minimizes  tlie  fill  for  arbi¬ 
trary  graphs  is  known  to  be  NP-hard  [32]. 

The  llrst  analysis  for  a  variant  of  nested  dissection  for  graplis  with  small 
separators  (of  size  0(\/n)  in  an  n-node  graph)  was  given  by  Lipton.  Rose  and 
Tarjan  [21].  The  fill  introduced  by  this  variant  is  0(ytlog  n)  on  an  //.-node  graph. 
Subsequently.  Gilbert  and  I'arjan  [14]  analyzed  the  original  nested  dissection 
algorithm  of  George  and  Liu  for  planar  graphs,  and  showed  that  using  small 
separators  in  the  recursive  procedure  yields  a  fill  of  0(//log//)  [22].  I'hey  also 
point  out  that  this  Jiiethod  does  not  work  in  general  for  graphs  with  small 
separators  by  constructing  a  counterexample.  Both  of  these  papers  [14.  21]  also 
show  a  bound  of  0(//^)  on  the  work  of  the  orderings.  It  is  interesting  to  note 
that  there  are  //-node  planar  graphs  (square  grids  in  particular)  for  which  any 
elimination  ordering  introduces  fill  0(//.log//.)  [7]. 

Agrawal,  Klein  and  Ravi  [1]  gave  the  first  approximation  algorithms  for  elim¬ 
ination  orders  that  simultaneously  minimize  the  fill,  height  and  the  work,  all 
within  a  polylogarithmic  factor  when  the  degree  of  the  input  graph  is  bounded, 
riieir  algorithm  is  essentially  the  nested  dissection  algorithm  using  approxi- 
jiiately  minimum-size  balanced  node  separators  [18]  to  construct  the  recursive 
decomposition.  I'hey  also  analyze  the  fill  and  the  height  of  their  ordering  when 
the  degree  of  the  graph  is  not  bounded.  The  key  dilference  between  our  work 
and  these  results  is  that  we  start  with  a  chordal  completion  of  a  graph,  and 
focus  our  eJforts  on  finding  parallel  elimination  orders  with  linear  fill. 

1.4  Related  work:  Height 

Ignoring  fill,  computing  an  elimination  ordering  for  a  given  graph  with  minimum 
height  is  NP-hard  [30],  and  remains  so  even  if  an  additive  error  in  the  estimate 
of  the  height  is  allowed  [5].  Pan  and  Reif  give  one  of  the  first  analyses  of  the 
parallel  height  of  jiested  dissection  orderings  as  well  as  how  nested  dissection 
can  be  used  for  solving  the  shortest  path  problem  in  graphs  [28,  27].  Bodlaender 
et  al.  [5]  uses  an  approach  similar  to  [1]  to  find  elimination  orders  with  bounds 
on  the  height  and  several  related  parameters.  Both  these  papers  [1.  5]  give 
elimination  orders  with  height  at  most  0(log*'  //)  times  the  minimum  possible, 
for  any  //-node  graph.  Numerous  heuristics  without  performance  guarantees  are 
also  known  for  this  problem  [10,  IG,  10,  20,  24,  25]. 

1.5  Outline 

'Lhe  remainder  of  this  paper  is  organized  as  follows.  In  the  next  section,  we 
introduce  some  definitions.  We  present  two  algorithms  for  finding  parallel  elim¬ 
ination  orders  for  interval  graphs.  'Plie  first  algorithm,  which  is  based  on  nested 
dissection,  is  described  in  Section  3.  The  second,  which  has  linear  fill,  is  pre- 
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bellied  iu  Section  4.  We  then  show  in  Section  5  how  tliebe  algorithms  can  be 
used  to  find  elimination  orders  for  chordal  graphs.  Some  experimental  results 
obtained  for  an  implementation  of  the  algorithm  in  Section  5  can  be  found  in 
Section  6.  We  conclude  with  some  remarks  in  Section  7. 


2  Definitions 

In  order  to  proceed,  we  need  to  establish  some  notation  concerning  matrices 
and  graphs. 

Eacli  step  of  Gaussian  elimination  on  a  symmetric  matrix  M  corresponds  to 
choosing  a  vertex  (/  in  G.  adding  edges  to  G  if  necessary  to  make  v’s  neighbor¬ 
hood  a  clique  and  then  removing  v  from  G.  v  is  said  to  have  been  tlirrtinaltd 
from  G.  Any  new  edges  introduced  by  the  elimination  of  a  vertex  are  called  fill 
edges,  or  simply  ftli  A  vertex  r;  is  sunplicial  in  G  if  its  neighborhood  N  (v)  is  a 
clique  of  G.  Simplicial  vertices  are  of  special  interest,  since  the  elimination  of  a 
simplicial  vertex  does  not  introduce  any  fill  edges. 

Alternatively,  we  can  think  of  Gaussian  elimination  as  simply  inserting  the 
fill  edges  in  a  graph.  In  this  case,  the  elimination  of  a  vertex  corresponds  to  the 
introduction  of  edges  between  any  pair  of  its  neighbors  that  are  not  connected, 
and  are  later  in  the  elimination  ordering  than  the  vertex  being  considered.  The 
graph  augmented  with  all  the  fill  edges  is  referred  to  as  the  updaUtl  gmpli.  Given 
two  non-adjacent  vertices  'i;  and  w  in  a  graph  G.  there  exists  a  fill  edge  (i;.  u;) 
between  them  in  the  updated  graph  iJf  there  exists  a  path  from  v  to  w  going  only 
through  vertices  numbered  lower  than.  i.e..  that  are  eliminated  before,  both  v 
and  w. 

An  ordering  -  of  the  vertices  of  G  is  a  ptjfecl  eliminalion  or- 

dtiing  if  it  does  not  introduce  any  fill  edges,  i.e.,  if  each  Vi  is  simplicial  in 
G  —  {vi; . , . ,  Vt-i}.  A  graph  is  said  to  be  chordal  if  it  has  a  perfect  elimination 
ordering.  Equivalently,  a  graph  is  chordal  if  every  simple  cycle  with  more  than 
three  vertices  has  a  chord  [t),  31],  i.e.,  no  induced  subgraph  of  G  is  isomorphic 
to  a  cycle  with  more  than  three  vertices. 

The  irderstclioji  graph  of  a  family  F  of  sets  5,  is  the  graph  obtained  by 
associating  a  vertex  with  each  set  Si.  and  edges  (vi.Vj)  whenever  Si  intersects 
Sj.  One  characteriiialion  of  chordal  graphs  that  has  proved  particularly  useful 
is  as  the  intersection  graphs  of  subtrees,  that  is,  connected  subgraphs,  of  a  tree. 
We  call  the  tree  in  question  a  nkclcloji  of  llie  chordal  graph  G.  Along  with  the 
subtrees  it  forms  a  bet  rtprtstnlalion  of  G.  A  tree  representation  of  a  graph  G  is 
said  to  be  minimal  if  the  associated  skeleton  has  the  minimum  number  of  nodes 
possible.  Gavril  [11]  and  Buiieman  [G]  showed  that  in  a  minimal  representation 
there  is  a  one-to-one  correspondence  between  vertices  of  7  and  maximal  cliques 
of  G.  Alternatively,  we  can  consider  the  nodes  of  T  to  be  formed  by  sets  of 
vertices  of  G  so  that  for  eacli  vertex  v  of  G  a  subtree  Ta  induced  in  7  by 
the  nodes  that  contain  v  can  be  used  to  represent  v.  %  is  said  to  be  the 


Tepresentalive  subbee  of  A  miiiiiiial  tree  represent atioii  of  G  is  called  a  clique 
bee  of  G. 

Tlirouglioul  this  paper,  we  refer  to  vertices  in  a  graph,  but  we  reserve  the 
term  node  to  refer  to  vertices  in  the  skeleton  of  a  chordal  graph  and  to  vertices 
in  separator  trees,  that  is.  trees  whose  nodes  correspond  to  separators  in  the 
original  graph.  In  both  cases,  nodes  typically  correspond  to  sets  of  one  or  more 
vertices.  Similarly,  we  reserve  the  term  link  to  refer  to  edges  between  nodes  in 
a  skeleton  of  a  chordal  graph,  A  subtree  %  is  said  to  cover  a  node/link  of  the 
skeleton  if  that  node/link  is  in  7^.  A  terminal  branch  of  7’  is  a  maximal  path 
from  a  leaf  v  to  a  node  w  in  T  that,  except  for  v  and  w.  only  contains  degree-2 
nodes. 

An  important  subclass  of  chordal  graphs  are  the  interval  graphs,  whidi  are 
chordal  graphs  that  have  a  skeleton  that  is  a  path.  A  tree  representation  with  a 
path  for  a  skeleton  is  also  called  an  interval  lepresenlation,  for  the  representative 
subtrees  are  also  just  paths,  and  can  be  interpreted  as  intervals. 

3  Parallel  elimination  orders  for  interval  graphs: 
nested  dissection 

In  this  section  we  analyze  a  simple  nested  dissection  algorithm  that  chooses  a 
balanced  separator  at  each  step,  thus  producing  a  logarithmic  depth  separator 
tree.  VVe  show  an  upper  bound  of  0(/n  •  \/log  n)  on  the  amount  of  hll  for  the 
orderings  produced. 

Given  a  graph  G.  an  a~balanced  separator  of  G  =  {V,  E)  is  a  set  of  nodes 
S'  C  such  that  no  connected  component  of  —  S'  has  more  than  «  •  |V^| 
vertices,  for  some  constant  fraction  a  <  1.  An  a^balanced  sepamtor  tree  is  one 
whose  nodes  are  o-balanced  separators  of  the  subgraphs  of  G.  I'lie  root  of  the 
tree  is  an  tv-balanced  separator  of  G.  and  we  build  a  tree  recursively  for  each 
component  and  attach  them  as  subtrees  of  the  root.  From  now  on,  whenever 
we  use  the  term  balanced  separator  we  simply  mean  an  cv-balanced  separator, 
for  some  constant  tv. 

Nested  dissection  on  an  interval  graph  1  builds  a  balanced  separator  tree 
whose  nodes  are  minimal  separators  of  subgraphs  of  I .  For  interval  graphs, 
every  minimal  separator  of  the  graph  corresponds  exactly  to  the  set  of  vertices 
that  cover  some  link  of  its  skeleton  F.  VVe  order  this  tree  so  that  an  in-order 
transversal  of  the  separator  tree  corresponds  to  a  left-to-right  transversal  of  the 
links  of  F.  When  necessary  we  will  refer  to  an  oidered  separator  tree  to  make 
it  clear  that  we  are  considering  a  separator  tree  whose  children  are  ordered  as 
described  here. 

As  long  as  the  algorithm  chooses  tv-balanced  separators,  the  depth  of  the 
separator  tree  is  O(logn),  since  each  node  has  left  and  right  subtrees,  which 
have  no  more  than  an  tv-fraction  of  the  vertices  in  the  subtree  rooted  at  that 
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node. 


3.1  Analysis 

Even  Ihougli  the  separator  tree  itself  has  deptli  O(logn).  tlie  corresponding 
elimination  order  can  potentially  be  fairly  unbalanced,  since  the  separators  will 
probably  have  dilTerent  sizes.  Every  separator  is  a  clique  in  the  corresponding 
graph  and  hence  its  size  is  a  lower  bound  on  the  height  of  any  elimination  order. 
If  the  depth  of  the  separator  tree  is  d.  we  get  the  following  lemma,  which  assures 
that  this  unbalance  can  be  at  most  a  logarithmic  factor. 

Lemma  1  [1]  Let  G  be  a  graph.  A  depth  d  miniTnal  balanced  separator  tree  for 
G  produces  an  ordering  of  depth  within  a  factor  of  d  of  the  optimal. 

Proof.  Let  s  be  the  number  of  vertices  in  the  largest  minimal  separator  S  in 
the  tree,  flie  ordering  defined  by  the  tree  has  depth  at  most  d'  s.  Let  G'  be 
the  graph  obtained  from  G  by  adding  all  the  fill  edges  introduced  by  an  optimal 
ordering  of  the  vertices  of  G.  G*  is  chordal  since  that  optimal  ordering  for  the 
vertices  of  G  is  a  perfect  elimination  ordering  for  G^  G  is  a  subgraph  of  G^ 
and  the  largest  minimal  separator  of  G'  must  have  at  least  .v  vertices.  Since  G' 
is  chordal,  every  mininial  separator  of  G"  is  a  clique  and  thus  any  elimination 
ordering  for  the  vertices  of  G*  must  require  at  least  s  steps.  ■ 

We  now  proceed  to  bound  the  total  number  of  fill  edges  introduced  by  the 
nested  dissection  algorithm.  In  the  lemmas  that  follow,  we  only  consider  non¬ 
trivial  interval  graphs,  that  is.  we  assume  that  the  graphs  in  question  have  at 
least  two  distinct  maximal  cliques.  We  also  assume  that  any  pre-existing  sim- 
plicial  vertices  have  been  eliminated  from  the  graph,  flius,  no  representative 
subtree  consists  of  a  single  node  since  we  do  not  obtain  a  new  interval  represen¬ 
tation  after  the  initial  elimination  of  simplicial  vertices. 

Figure  1  shows  part  of  a  separator  tree  of  an  interval  graph.  Each  node 
in  the  tree  corresponds  to  a  minimal  separator  of  the  graph.  The  elimination 
ordering  specified  by  the  separator  tree  might  introduce  fill  edges  between  a 
vertex  v  in  A  and  vertices  in  right  subtree,  as  depicted  by  the  dotted  edges. 
In  this  case  v  must  be  adjacent  to  some  vertex  in  i^’s  right  subtree  as  depicted 
by  the  edge  in  the  figure. 

We  define  an  inner  path  of  a  node  .4  in  an  ordered  binary  tree  as  the  path 
that  starts  with  the  edge  to  the  left  or  right  child  of  .4.  and  goes  all  the  way  to 
the  in-order  predecessor  or  successor  of  A.  respectively.  Fhe  next  lemma  states 
that  amounts  of  fill  in  excess  of  0(tn)  must  be  between  a  node  and  its  inner 
paths. 

Lemma  2  Let  I  be  a  connected  interval  graph.  The  total  amount  of  fill  between 
vertices  in  separator  nodes  of  an  ordered  balanced  separator  tree  of  i  and  vertices 
not  in  the  corresponding  inner  paths  is  0(rn). 
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Figure  1:  fill  among  vertices  in  a  separator  tree  of  an  interval  graph. 


Proof.  Let  v  be  a  vertex  in  a  separator  node  A,  which  has  fill  to  vertices  not 
in  one  of  A’s  inner  paths.  Let’s  examine  the  right  subtree  of  A.  fhe  left  one 
is  analogous.  Let  be  a  node  in  A'a  right  inner  path,  whose  right  subtree 
contains  vertices  to  which  v  has  fill.  'I’lieii  there  exists  a  path  from  v  to  vertices 
in  separator  nodes  in  B'a  right  subtree  that  does  not  go  through  vertices  in  B. 
Otherwise  there  would  be  no  fill  to  vertices  in  that  subtree,  since  the  vertices 
in  B  are  eliminated  after  those  in  the  subtree.  Fhus.  v  must  cover  the  link 
in  the  skeleton  corresponding  to  B.  and  the  links  corresponding  to  each  of  the 
nodes  in  B\  left  subtree.  Hence  v  is  adjacent  to  all  vertices  in  B  and  in  H’s  left 
subtree.  In  particular,  this  implies  that  for  a  given  v.  only  one  such  B  can  exist. 
Otherwise,  let  C  be  another  such  node  in  the  right  inner  path  of  A.  Without 
loss  of  generality,  C  is  in  B'a  left  subtree,  and  thus  v  is  already  adjacent  to  all 
vertices  in  C”s  left  and  right  subtrees,  which  contradicts  the  assumption  that 
there  is  fill  from  v  to  a  vertex  in  C”s  right  subtree. 

B  was  chosen  so  that  its  right  subtree  has  at  most  an  cv-fraction  of  the 
vertices  in  the  whole  subtree  rooted  at  B.  Moreover,  v  is  adjacent  to  all  vertices 
in  B  and  in  H’s  left  subtree.  Thus  the  number  of  fill  edges  from  v  to  the  right 
subtree  is  0(d(Y;)).  By  applying  this  same  argument  to  all  vertices  to  account 
for  fill  to  vertices  not  in  their  inner  paths  of  the  corresponding  separators  we 
get  a  total  of  0(m)  fill  edges.  ■ 

Lemma  2  allows  us  to  concentrate  on  fill  involving  vertices  in  iiuier  paths. 
Consider  one  such  inner  path. 

Lemma  3  Ltl  i  be  a  connected  interval  graph,  and  let  I/q  be  a  node  in  an 
ordered  balanced  separator  tree  of  I.  Let  Vi ,  •  •  •  i  Vk  be  the  nodes  in  Vq 's  right 

inner  path.  The  total  amount  of  fdl  between  Vq  and  vertices  in  Us  right  inner 


ptdh  is  al  most  0(y/k  •  |KP). 


Proof.  Let  /i,  =  iV^j.  'Llie  total  amount  of  fill  from  Vq  1^  inner  path 

is  at  most  /io  •  +  •  •  •  +  Let  fL\  +  /42  +  •  •  •  +  iik  ~  We  must  bound 

tlie  amount  of  fill  as  a  function  of  the  sum  of  tlie  74* ’s  squared,  which  is  a  lower 
bound  on  the  number  of  edges  in  U^-.  Thus,  we  are  looking  for  the  least  number 
X  such  that  74o  •  d  <  x  •  ^  A’(d/A')^.  Thus  we  obtain 

X  •  /4o  —  d  •  74o  +  X  •  d^/k  >  0.  As  long  as  x  is  positive,  it  suffices  to  choose  x  such 
that  this  second  degree  equation  on  /4o  does  not  have  two  distinct  real  roots. 
Thus  X  must  satisfy  d’^  —  4x'"d“/Ar  <  0.  i.e..  x  >  y/k/‘2  and  the  total  amount  of 

Since  a  separator  is  in  at  most  4  inner  paths,  and  a  balanced  separator  tree 
has  O(log74)  depth.  Lemmas  2  and  *S  give  the  following  corollary: 

Corollary  1  Ltl  I  bt  a  conntcltd  inltival  gi'aph,  with  a  balanced  stpamlor 
bee.  The  total  amount  of  fill  induced  by  the  ordering  specified  by  the  tree  is 

0(774  •  \/log74). 

Proof.  According  to  Leiiima2.  the  total  amount  of  fill  is  at  most  0(m)  plus  the 
amount  of  fill  to  inner  paths.  Apply  Lemma  3  to  all  inner  paths.  Each  separator 
is  in  at  most  two  inner  paths,  and  has  at  most  one  left  and  one  right  inner  path. 
Since  the  tree  is  balanced,  the  largest  inner  path  has  0(log74)  length.  All  that 
remains  to  be  shown  is  that  the  sum  of  the  squares  of  the  si:ses  of  the  separators 
in  the  tree  is  0(774).  But  each  separator  is  a  clique,  and  each  vertex  shows  up  in 
only  one  separator,  so  that  a  separator  with  74*-  vertices  has  74* (74*  —  l)/2  edges 
that  do  not  appear  in  any  other  separator.  For  74,  >  1.  lif  <  2(74* (74,  —  1)), 
To  handle  the  case  Ui  =  1  we  note  that  the  graph  is  connected  and  thus  every 
vertex  must  be  adjacent  to  at  least  one  other  vertex  in  the  graph;  since  that 
edge  can  only  be  considered  by  those  two  vertices,  we  have  the  desired  result. 


3.2  An  example 

It  is  not  hard  to  find  examples  that  show  that  if  the  nested  dissection  algorithm 
is  forced  to  choose  (l/2)-balanced  separators  then  the  bound  derived  in  the 
previous  section  is  tight. 

Since  the  algorithm  being  used  has  to  choose  a  (l/2)-balanced  minimal  sep¬ 
arator.  we  caii  build  an  interval  graph  with  not  too  many  edges  and  such  that 
at  each  step  the  algorithm  can  oidy  make  a  single  choice.  For  simplicity  we 
construct  a  graph  such  that  the  fill  from  the  root  node  to  one  of  its  inner  paths 
is  enough  to  achieve  the  bound. 

Except  for  the  root  separator,  and  the  separators  in  the  root’s  right  inner 
path,  all  other  separators  have  a  single  vertex,  and  are  distributed  so  as  to  make 
sure  that  all  separators  are  in  fact  (l/2)-balanced  separators  for  the  subgraphs 
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induced  by  tlie  bubtree  rooted  at  tliat  beparator  node.  Let  tiQ  be  tlie  size  of  the 
root  beparator.  and  let  s  be  the  bize  of  each  of  the  other  beparatorb  in  the  rooLb 
right  inner  path.  Our  bample  graph  can  be  obtained  by  making  a  clique  out  of 
each  of  the  beparatorb.  and  connecting  verticeb  in  each  beparator  with  those  in 
its  ill-order  buccessor  and  predecessor  separator  nodes. 

riie  total  number  of  vertices  in  the  graph  is  0(2*  •  s  +  no),  where  k  is  the 
number  of  nodes  other  than  the  root  separator  in  the  root's  right  inner  path. 

If  k  =  log  no  then  the  total  number  of  vertices  in  the  graph  is  0(no  •  4>0* 

The  verticeb  in  the  root  separator  have  a  total  of  0(no  +  no  •  a)  edges, 
to  themselves,  and  0(no  •  s)  to  the  vertices  in  a  separator  with  s  vertices  that 
they  are  adjacent  to.  'The  vertices  in  that  separator  of  size  s  have  0(i;-  (no  -!-&■)) 
edges,  while  the  remaining  separators  with  s  vertices  have  0{s^)  edges.  One 
other  vertex  is  adjacent  to  the  no  vertices  in  the  root  separator  thus  having 
0(no)  edges,  and  0{*2k)  vertices  are  adjacent  to  one  of  the  separators  with  s 
vertices,  and  thus  have  0(&*)  edges  each.  The  remaining  0(no  •  *)  vertices  have 
0(1)  edges  each.  The  total  number  of  edges  in  the  graph  is  thus  0{k  •  +  n^). 

The  total  amount  of  fill  is  Q(no  ♦  a  •  log  no)  and  if  we  choose  a  =  no/v^og~no, 
the  total  number  of  edges  is  0(no).  while  the  amount  of  fill  is  l"l(n§  •  ^og  no ) . 

4  A  linear-fill  0(log^?i)-depth  algorithm 

111  this  section  we  present  a  recursive  algorithm  that,  given  an  interval  graph, 
finds  an  0(log^  n)-depth  separator  tree  that  represents  the  elimination  ordering 
for  the  vertices  in  the  graph.  Unlike  traditional  separator  trees,  vertices  can 
appear  multiple  times  in  the  tree. 

The  algorithm  is  composed  of  three  phases,  which  operate  on  a  skeleton  path 
of  an  interval  graph,  'fhe  analysis  of  the  algorithm  uses  a  potential  function 
whose  value  is  0[tn)  initially  and  is  used  to  account  for  the  fill  edges.  The  last 
of  the  three  phases  is  carried  out  to  ensure  that  we  do  not  charge  to  the  same 
part  of  the  potential  function  multiple  times.  This  is  done  by  keeping  track  of 
which  edges  are  “depleted”  of  their  contribution  to  the  potential,  and  dividing 
the  graph  into  subgraphs  with  predominantly  non-depleted  edges  to  recurse  on. 

rhe  first  phase,  homogtnizt.  finds  up  to  k  =  O(log  -n)  separators  that  divide 
the  graph  into  k-\-l  components.  The  sizes  of  these  separators  are  geometrically 
decreasing,  a  property  that  is  useful  in  accounting  for  fill  induced  to  any  of 
these  separator  vertices.  The  next  phase,  which  we  call  halving,  is  analogous  to 
a  regular  nested  dissection  iteration;  we  simply  select  a  separator  that  divides 
the  skeleton  of  the  interval  graph  we  are  currently  working  with  in  half.  As 
in  nested  dissection,  this  ensures  that  the  algorithm  finishes  within  O(log  n) 
iterations  of  the  phases,  thus  producing  an  ordering  with  good  height.  Finally, 
the  algorithm  performs  the  kill  pliase.  As  mentioned  earlier,  the  purpose  of  this 
phase  is  to  ensure  that  the  potential  function  is  used  correctly  to  account  for 
the  fill.  File  kill  phase  accomplishes  this  by  dioosing  special  kinds  of  separators 
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called  beuliiiels  that  localize  subsequent  fill  to  subgraphs  that  contain  enough 
non-depleted  edges  (whose  potential  contribution  is  as  yet  unused).  In  choosing 
sentinels  to  ensure  this,  we  incur  an  extra  log'n  factor  in  the  height  of  our 
ordering,  since  we  select  up  to  log  n  sentinels  per  kill  phase. 

We  also  analyze  a  chordal  graph  version  of  our  interval  graph  algorithm, 
which  is  described  in  more  detail  in  Section  5.  Ihe  algorithms  are  essentially 
the  same,  except  that  when  dealing  with  chordal  graphs  we  have  a  skeleton  that 
is  a  tree/not  a  path.  We  can  apply  the  interval  graph  algorithms  to  eliminate 
each  of  the  branches  (paths)  of  the  skeleton  that  lead  to  leaves  of  the  tree.  We 
repeat  this  step  until  the  whole  tree  has  been  considered. 

4.1  Definitions  used  in  the  algorithm 

An  edge  is  said  to  be  an  txlrtjnily  of  a  tree  if  it  is  an  edge  to  some  leaf  of  the 
tree.  To  iiistrl  a  link  e  of  the  skeleton  into  the  separator  tree  consists  of  adding 
to  the  tree  the  separator  formed  by  those  vertices  of  the  chordal  graph  whose 
representative  subtrees  cover  t,  A  link  of  the  skeleton  is  said  to  be  a  root  if  it 
has  been  inserted  into  the  separator  tree.  A  rooted  skeleton  is  a  skeleton  whose 
extremities  are  roots. 

A  vertex  v  and  its  representative  subtree  are  said  to  be  pmntd  at  a  link 
/■  if  T  is  a  root  and  either  %  covers  r  or  %  is  a  singleton  covering  one  of  the 
vertices  of  t.  Some  subset  of  the  roots  is  said  to  be  dtpltltd  in  G.  A  vertex  is 
said  to  be  depleted  if  it  is  pinned  at  a  depleted  link.  Whenever  we  refer  to  a 
pinned  vertex,  it  is  iiot  depleted,  unless  explicitly  stated.  Ihe  term  depleted  is 
used  to  help  us  keep  track  of  which  edges  in  the  input  graph  have  been  used 
to  pay  for  Jill  and  can  no  longer  be  used.  Tdges  between  paiis  of  depleted 
vertices  are  also  said  to  be  depleted.  Edges  between  pinned  vertices  are  said  to 
be  pirmtd  edges.  Unless  otherwise  stated,  the  term  pinned  edges  only  refers  to 
non-depleted  pinned  edges.  A  vertex  is  said  to  be  internal  to  a  graph  if  it  is 
not  pinned.  Edges  to  internal  vertices  are  also  said  to  be  internal,  regardless  of 
whether  the  other  endpoint  of  the  edge  is  internal. 

Let  G  be  an  interval  graph,  with  skeleton  T.  We  denote  Fi^r  the  path  between 
and  including  the  two  links  I  and  /*  in  7‘,  We  denote  P(l,  r)  the  interval  graph 
obtained  by  restricting  G  to  Pi^r  eliminating  any  single  vertex  representative 
subtrees.  Given  a  representative  subtree  7*,  associated  with  a  vertex  v  of  G.  let 
Tl  be  the  path  induced  in  %  by  P[l,  r)  is  the  interval  graph  that  has  those 
Tl  with  two  or  more  nodes  in  their  representative  subtrees  on  the  skeleton 

The  ply  Pn  of  a  link  e  of  7  is  the  number  of  subtrees  7t,  that  cover  that  link. 

4.2  The  algorithm 

Given  an  interval  graph  i,  and  an  interval  representation  of  i,  with  skeleton 
P.  whose  extremities  are  I  and  r,  we  remove  any  simplicial  vertices  of  1,  insert 
both  I  and  r  into  the  separator  tree,  and  apply  the  procedure  homogenize  to 
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it.  Eliiiiiiialiiig  simplicial  vertices  does  not  cliange  tlie  skeleton  of  tlie  graph, 
but  rather  eliminates  any  single  node  representative  subtrees.  Since  none  of  the 
steps  of  the  algorithm  creates  these  single-node  sub-paths,  later  steps  do  not 
have  to  deal  with  them. 

Each  step  of  the  algorithm  inserts  one  or  more  links  of  the  skeleton  into  the 
separator  tree,  resulting  in  a  number  of  subgraphs.  Let  Ki(ti.ti+i)  denote  the 
graph  obtained  from  by  removing  all  vertices  pinned  at  /  as  well  as 

those  that  cover  both  e,-  and  Ci+i. 

The  algorithm  consists  of  three  major  procedures  that  call  each  other  recur¬ 
sively.  Each  procedure  inserts  some  vertices  into  the  separator  tree  thus  creatuig 
subgraphs  to  which  the  next  procedure  is  applied  as  long  as  there  exists  at  least 
one  vertex  internal  to  the  subgraph.  Each  procedure  operates  on  an  interval 
graph  y.  a  skeletoii  path  F  oi  L  and  F^a  two  extremities.  /  and  r.  I'he  first 
procedure,  homogenize,  divides  the  interval  graph  in  a  number  of  subgraphs  and 
then  applies  the  halving  procedure  to  each  one  of  them.  Figure  2  illustrates  this 
process. 


Figure  2:  T'he  homogenize  procedure  devides  a  graph  into  a  number  of  sub¬ 
graphs.  by  selecting  up  to  O(log  n)  edges.  Edges  are  chosen  starting  from  both 
extremities,  so  that  their  ply  decreases  geometrically. 


Homogenize(y.  F.  I,  r) 
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Select  /.  and  transverse  F  towards  r.  selecting  tlie  first  link  whose  ply  is  at  most  half  the 
ply  of  the  last  selected  link.  Repeat  until  r  is  reached.  Apply  the  same  algorithm  from  r 
to  1.  Let  ti,  0  <  '/  <  A'  +  1.  be  the  links  that  were  selected  ordered  from  I  to  r,  including 
/  =  Cq  and  r  =  ejt+i .  Insert  all  the  selected  links  except  I  and  r  into  the  separator  tree, 
and  do  Halving(/^(e^.  e,+i),  for  all  i  between  0  and  k  for  which  some 

vertex  in  e^^.i)  is  not  in  the  elimination  tree  yet. 

I'he  halving  procedure  simply  does  what  its  name  suggests,  that  is,  divides 
the  problem  in  two  subproblems  that  are  no  more  than  half  the  si;4e  of  the 
original  one. 

Halving(y,  F,  I,  r) 

Choose  a  link  m  in  F  sucli  that  when  m  is  inserted  into  the  separator  tree,  both 
Fi^f,i  and  F„i  ^  have  no  more  than  half  as  many  skeleton  links  as  F  did.  riien  do 
Ki\\(F(l,  m),  (a^id  [\i\\(F(tn,r) ,  Ffn^f./tn.  r)),  as  long  as  F(l,  ‘m)  (F(7n.  r))  has 

some  vertex  that  has  not  been  inserted  in  the  separator  tree. 

Finally,  the  kill  procedure  divides  an  interval  graph  into  a  number  of  sub¬ 
graphs.  and  from  each  one  it  removes  vertices  that  have  either  been  depleted 
or  cover  the  entire  piece  of  the  skeleton  corresponding  to  that  subgraph.  I'his 
reestablishes  the  preconditions  of  homogenize,  which  is  applied  to  each  of  the 
resulting  subgraphs.  Figure  3  illustrates  the  kill  procedure  applied  to  an  interval 
graph.  Fhe  dotted  paths  are  pinned  at  the  depleted  root  /  and  correspond  to 
the  depleted  vertices. 

Ki\\(i,FJ,r) 

Assume  the  ply  at  I  is  at  least  the  ply  at  r.  i.e.,  pi  >  p,..  Otherwise,  swap  the  roles  of  I 
and  /'  in  this  algorithm.  From  r  to  /  in  F.  select  the  first  link  that  covers  a  vertex  that 
is  pinned  at  /.  Keep  scanning  F  towards  /.  and  selecting  the  first  link  that  covers  at 
least  twice  as  many  vertices  pinned  at  I  as  did  the  last  selected  link.  Call  these  rnilt slant 
links.  Also  select  the  links  adjacent  to  the  milestones,  which  are  closer  to  r  than  the 
corresponding  milestone,  and  call  those  stnlintls.  Insert  the  links  that  were  selected  into 
the  separator  tree  in  order,  from  I  to  r.  Call  those  links  ti.  including  /  =  cq  and  r  = 

Apply  Flomogenize(AJ(e;,  e,+i)  has  at 

least  one  vertex  that  hasn’t  been  inserted  into  the  separator  tree.  Note  that  when  and 
^,•4.1  are  a  milestone  and  its  corresponding  sentinel  all  vertices  in  A(ei,  have  already 
been  ordered. 
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Sentinel  — ^ 
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t  t  ft  t  t  t  r 


Figure  3:  Tlie  kill  procedure  yelecls  miles toiiea  and  the  corresponding  sentinels 
according  to  the  number  of  paths  pinned  at  tlie  depleted  root  L 


4,3  Analysis 

A  chordal  graph,,  and  in  particular  an  interval  graph  I  has  at  most  n  maximal 
cliques,  and  thus  at  most  a  nodes  in  its  clique  tree.  Just  before  the  first  re¬ 
cursive  invocation  of  homogeniiie.  the  three  procedures  have  partitioned  i  into 
subgraphs  that  liave  skeletons  with  no  more  tlian  half  the  number  of  links  in  the 
skeleton  of  L  Since  the  three  procedures  add  O(logyi)  nodes  to  the  separator 
tree,  and  log /t  iterations  of  those  three  procedures  might  be  necessary,  the  depth 
of  the  tree  generated  by  this  algorithm  is  0(log*'  w).  Since  every  separator  is  a 
clique  of  1.  the  ordering  produced  has  height  at  most  0(C  •  log*^  n).  where  C  is 
the  size  of  the  maximum  cliq  ue  of  7 . 

4.3.1  Bounding  the  amount  of  fill 

We  can  obtain  bounds  on  the  amount  of  fill  and  work  that  are  incurred  by  the 
orderings  produced  by  our  algorithm  which  are  summarized  in  the  next  lemma. 

Lemma  4  Ltl  I  be  an  inltival  graph  with  n  vertices  and  tn  edges.  When  applied 
to  1,  the  ulgoiilhm  presented  in  Section  4-^  produces  an  oideiing  with  height 
0{C  •  log^  n).  fdl  0(m),  and  work  0(W'‘(l)).  wheie  C  is  the  size  of  the  laigest 
clique  in  I  and  VK"(7)  is  the  minimum  amount  of  work  required  to  perfoim 
Gaussian  eliininalion  on  I  according  to  any  ordering. 

We  now  deline  a  potential  function  that  will  be  used  to  bound  the  amount 
of  fill  introduced  by  the  algorithms.  Let  G  be  a  chordal  graph  and  let  T  be  a 
skeleton  of  G  at  some  stage  in  the  algorithm.  Let  s  be  the  number  of  links  of 
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T  that  are  not  roolis.  Let  x*  be  the  number  of  internal  edges  of  G.  and  y  the 
number  of  pinned,  non-depleted  edges.  Tlie  potential  is  given  by 


4>(G)  =  3  •  X*  +  ;v  +  &•. 


Given  an  initial  connected  graph,  we  take  the  skeleton  T  to  be  a  clique  tree 
of  tlie  graph.  Since  tlie  graph  is  chordal.  T  can  only  have  as  iiiany  vertices  as 
the  original  graph,  and  tlius  the  potential  of  a  graph  is  0(m).  I’his  potential 
is  used  to  pay  for  all  the  fill  introduced  by  our  algorithm.  To  do  this,  at  each 
step  in  the  recursion,  we  ensure  that  some  llxed  constant  times  the  dillerence  in 
potential  between  the  initial  graph  and  the  subgraplis  in  which  that  step  divides 
the  graph  is  enough  to  pay  for  any  fill  edges  that  are  introduced  because  of  tliat 
step  (See  condition  [in)  later  in  this  appendix). 

By  examining  the  different  kinds  of  edges  in  the  interval  graph,  we  can 
determine  the  following  change  in  the  potential  function  when  a  new  node  is 
inserted  in  the  separator  tree. 

Lemma  5  Ltl  i  be  an  inleival  graph  and  lei  P  be  a  rooted  skeleton  path  of  i 
with  roots  I  and  r,  such  that  only  I  is  depleted.  Let  m  be  a  link  in  the  skeleton, 
distinct  from  I  and  r,  If  m  and  I  are  roots  in  P(l,  rn),  I  being  depleted  in  P(l,  m), 
and  rn  and  r  are  roots  in  /^(m,  r),  rn  being  depleted  in  P{rn,r)  (but  not  in 
P{l,  rrt))  then  — ((l>{P{l,'fn))-\-<l>(P(rn,  r)))  >  l  +  rn'{rn' —  !)’{• ‘2rn^ (pfn  —  rrd), 
where  rn*  is  the  number  of  internal  ver  tices  that  cover  rn  in  P. 

Proof.  VVe  examine  all  types  of  edges,  one  at  a  time,  and  show  that  tlie  dif¬ 
ference  in  potential  comes  from  making  rn  a  root,  and  the  pinning  at  rn  of  rn* 
vertices  that  were  internal. 

Edges  that  are  depleted  in  I  are  also  depleted  in  P(l,rn).  If  a  depleted  edge 
is  present  in  P(rn,  r)  then  its  endpoints  must  cover  rn,  and  the  edge  is  also 
depleted  in  P(rn,r).  Iherefore,  depleted  edges  in  i  do  not  contribute  towards 
potential  in  either  P{1,  rn)  or  P{rn,  /  ). 

Pinned,  non-depleted  edges  in  i  either  occur  in  one  of  P{l,  rn)  or  P(rn,  r) 
or  cover  rn,  thus  being  depleted  in  P{rn,  r),  again  not  contributing  towards  any 
difference  in  potential  between  I  and  the  two  subgraphs. 

All  vertices  tliat  are  internal  to  P(l,  rn)  or  P(rn,  r)  are  also  internal  to  L 
Moreover,  since  they  do  not  cover  rn  tliey  only  occur  in  one  of  the  two  subgraphs, 
as  do  edges  to  internal  vertices.  Therefore,  edges  to  vertices  internal  to  P{l,  rn) 
or  P(rn,  r)  each  contribute  3  units  towards  the  potential  of  J  and  to  the  potential 
of  either  P{l,  rn)  or  P(rn,  r),  but  not  both. 

Since  rn  is  a  root  in  both  P{1,  rn)  and  P{rn,  r)  but  not  in  I  and  is  the  only 
link  that  is  common  to  the  skeletons  of  both  subgraphs  tliis  contributes  1  unit 
towards  tlie  decrease  in  potential. 

■"The  only  remaining  edges  are  those  from  internal  edges  of  I  whose  endpoints 
cover  rn,  and  are  thus  pinned  in  both  P{l,rn)  and  P(rn,r).  They  are  depleted 
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ill  P[m,  T).  but  not  in  F(l,  in).  Tlius  they  contribute  2  unitis  to  the  dilTerence  in 
potential.  The  total  number  of  such  edges  is  at  least  l)/2+m'(p,„  —  m^). 

and  the  total  dilference  in  potential  is  at  least  m'{m'  —  1)  +  2m^('Pfn  —  in')  +  1 

■ 

VVe  now  present  an  analysis  of  the  performance  of  our  algorithms  in  terms 
of  fill.  The  next  lemma  says  that  fill  is  local  to  the  subgraphs  defined  by  the 
separators  in  the  separator  tree. 

Lemma  6  Lei  I  be  an  inlei'val  graph  and  lei  F  he  a  rooted  akelelon  path  of  i 
with  eiiremity  roots  I  and  r.  Then  any  link  in  in  F  distinct  fmrn  I  and  r  can  be 
inserted  into  the  sepamtor  bee.  thus  dividing  i  into  two  subgraphs  F(l,  in),  with 
roots  I  and  m,  and  F{in,r),  with  roots  in  andr,  so  that  the  vertices  intenial  to 
each  of  the  subgiaphs  can  only  have  fill  to  other  vertices  in  that  same  subgmph. 

Proof.  Any  path  between  a  vertex  that  is  internal  to  F(l,  in)  and  another  that  is 
internal  to  F(in,  r)  must  go  through  some  vertex  that  covers  in.  Since  vertices 
that  cover  in  are  eliminated  after  all  the  internal  vertices  in  the  elimination 
order,  there  cannot  be  fill  between  such  internal  vertices. 

The  only  other  possibility  is  that  there  exists  fill  between  internal  vertices 
in  one  subgraph  to  pinned  vertices  of  the  other.  If  the  vertex  is  pinned  at  in, 
then  it  is  in  both  subgraphs,  and  there  is  nothing  to  prove.  Otherwise,  any  path 
between  the  two  vertices  must  still  go  through  some  vertex  pinned  at  in.  But 
vertices  pinned  at  in  are  eliminated  after  all  the  vertices  which  are  internal  to 
either  subgraph,  again  contradicting  the  possibility  of  fill  between  the  pair  of 
vertices.  ■ 

Let  F{1,  r)  be  an  interval  graph  at  the  begiiiiiiiig  of  a  phase  (either  homoge¬ 
nize,  halving  or  kill)  and  let  e  be  a  link  of  its  skeleton  path  F,  distinct  from  its 
roots  I  and  r.  When  inserting  e  into  the  graph's  separator  tree  we  require  that; 

i.  fill  between  vertices  rooted  at  I  and  r  must  have  been  accounted  for  in 
some  previous  step,  if  either  I  or  r  is  depleted,  and  otherwise  must  be 
accounted  for  in  the  current  step. 

ii.  fill  between  vertices  pinned  at  e  and  those  pinned  at  I  (and  r)  must  be 
accounted  for  in  the  current  step,  if  at  least  one  of  e  or  /  (respectively  r) 
is  depleted. 

iii.  A  constant  times  the  dilTerence  in  potential  between  the  original  graph 
and  the  parts  must  be  enough  to  pay  in  that  step  for  any  fill. 

Since  condition  (iii)  refers  to  the  dilTerence  in  potential,  the  total  amount 
of  fill  allowed  by  (iii)  is  a  constant  times  the  potential  of  the  initial  graph  and 
thus  0(in).  In  the  next  lemmas,  we  show  that  the  above  three  invariants  are 
maintained  as  we  perform  each  of  the  three  procedures  described  in  Section  4.2. 

Given  an  interval  graph  I,  the  homogenizing  procedure  divides  the  problem 
of  finding  an  ordering  for  the  vertices  of  I  into  a  number  of  subproblems,  each 
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of  wliicli  lias  Uie  same  desirable  properly,  namely  except  for  the  extremities,  the 
ply  of  every  link  in  the  skeleton  of  the  subgraphs  is  at  least  half  of  that  of  the 
extremity  of  the  skeleton  with  the  largest  ply.  If  this  condition  is  already  met, 
the  homogenizing  step  does  not  insert  any  links  into  the  separator  tree,  and  we 
go  into  the  next  step  of  the  algorithm  with  no  depleted  links. 

Lemma  7  (Homogenize  Step)  Let  I  be  an  mtej'val  giaph,  with  a  rooted  skeleton 
path  F,  Let  I  and  r  be  roots  of  F,  neither  being  depleted,  and  let  pi  >  p,. ,  Then 
Homogenize(I,F,Lr)  finds  k  =  0(logp()  links  of  the  skeleton  F.  If  k  >  \)  then 
the  selected  links  can  be  inserted  into  the  separator  liee  in  any  order,  defining 
subgraphs  F(ti,ei^i)  looted  at  ti  and  e,+i,  being  depleted.  Moreover,  except 
for  possibly  ti  or  e^^-i  the  links  of  the  skeleton  have  ply  greater  than  or 

equal  to  half  the  larger  of  p,j^  and  and  conditions  (i),  (ii)  and  (Hi)  can  be 
satisfied. 

Proof.  The  whole  selection  process  selects  no  more  than  k  <  logpf  +  logp,.  = 
0{logp()  links  of  the  skeleton,  aside  from  /  and  r.  T  he  depletion  of  the  endpoints 
can  be  seen  as  making  I  depleted,  and  then  applying  Lemma  5  repeatedly. 
Making  I  depleted  reduces  the  potential  of  the  graph  by  pi{pi  -  1)/^^,  while 
according  to  Lemma  5  each  insertion  produces  two  subgraphs,  further  reducijig 
the  potential  by  at  least  1  unit. 

According  to  Lemma  0,  after  we  insert  the  Jlrst  link,  say  ti  into  the  separator 
tree,  we  obtain  two  interval  graphs  F{l,ti)  and  F{ti,  r),  such  that  there  is  no 
fill  between  internal  vertices  in  distinct  subgraphs.  That  is.  no  matter  what 
elimination  order  we  choose  for  the  internal  vertices  of  each  subgraph,  all  the 
fill  to  the  other  subgraph  is  between  pinned  vertices. 

By  repeatedly  applying  this  argument  to  the  subgraphs,  and  since  each  link 
ti  is  not  depleted  in  F,  and  is  depleted  in  we  conclude  that  the 

lemma  holds,  as  long  as  the  fill  between  vertices  pinned  at  the  links  e,  is  smaller 
than  k  +  pi{pi  —  l)/2.  Fill  between  these  vertices  includes  all  the  Jill  between 
vertices  pinned  at  I  and  those  pinned  at  r,  fill  between  vertices  pinned  at  ti  and 
those  pinned  at  .  as  well  as  Jill  between  vertices  pinned  at  iion-consecutive 
links  ti,  induced  by  the  ordering  among  the  links  e<. 

The  total  number  of  vertices  pinned  at  any  links  e,  distinct  from  /  and  r  is 
at  most  the  sum  of  the  plies  of  the  links  a  and  that  is  at  most  (pi  -f  p,.)  <  2  •  p/. 

riiere  could  be  fill  between  vertices  pinned  at  I  and  those  pinned  at  r,  which 
amounts  to  at  most  pi  •  p,.;  let  V*  be  the  set  of  vertices  pinned  at  links  ti  other 
than  /  and  r.  T’liere  could  be  fill  among  the  at  most  pi  +  p^  vertices  in  V* ,  and 
also  from  vertices  in  V*  to  vertices  pinned  at  I  and  to  vertices  pinned  at  r.  These 
add  up  to  no  more  than  (pi  +  p,.y/2,  (pi  +  Pr)pi  and  (pi  +  Pr)Pr  respectively. 

Since  p,.  <  pi,  the  total  number  of  fill  edges  is  at  most  7pi^.  For  any  pi  this 
is  at  most  a  constant  times  k  +  pi(pi  —  l)/2.  ■ 

Specific  orderings  for  the  links  selected  by  the  homogenizing  algorithm  can 
result  in  smaller  constants  when  computing  fill,  and  in  better  or  worse  orderings 
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ill  terms  of  tlie  depth  of  the  separator  tree. 

As  long  as  tlie  skeleton  of  a  subgrapli  generated  by  tlie  algoritlim  described 
in  this  lemma  has  internal  vertices,  it  satisfies  all  the  pre-conditions  for  Lemma 
8  regarding  the  next  step  in  the  algorithm. 

Lemma  8  (Halving  Step)  Lei  I  be  an  interval  graph,  and  lei  F  be  a  rooted 
skeleton  path  of  i  with  at  least  3  links.  Let  I  and  r  be  Us  roots,  I  being  possibly 
depleted.  Moreover,  let  >  mtix(pi,Pf.)/2,  for  all  links  e  in  F.  Then,  Halv~ 
ing(I,F,l,r)  inserts  a  link  m  into  the  separator  tree  such  that  if  I  is  depleted  in 
F(l,  ‘tn)  and  m  is  depleted  in  F(m,  /*),  conditions  (i),  (ii)  and  (in)  are  satisfied. 

Proof.  As  long  as  F  has  more  than  two  links  the  halving  procedure  will  find 
such  a  link  rrt.  All  that  needs  to  be  shown  is  that  the  fill  described  in  conditions 
(i)  and  (ii)  can  be  paid  for  with  a  constant  times  the  dilference  in  potential 
between  i  and  the  subgraphs  F(l,  m)  and  F{m,  r),  as  prescribed  in  (hi). 

Assume  I  is  not  depleted  (and  neither  is  any  other  link  of  F].  Without  loss 
of  generality,  pi  >  p,..  We  can  deplete  I,  thus  decreasing  tlie  potential  of  i  by 
pi{pi  —  l)/2.  The  total  amount  of  fill  between  I  and  r  is  no  more  than  pf,  and 
as  long  as  >  1  we  can  pay  for  that  with  the  decrease  in  potential  resulting 
from  making  I  depleted.  If  pi  is  1.  then  p,.  can  be  at  most  1.  and  there  is  at 
most  1  fill  edge  between  vertices  pinned  at  I  and  vertices  pinned  at  r,  wliidi  can 
be  paid  for  when  making  rn  a  root,  fhe  decrease  in  potential  associated  with 
making  m  a  root  might  also  have  to  be  used  to  pay  for  edges  between  vertices 
that  cover  m  and  those  pinned  at  I  or  r,  as  follows. 

Assume  I  is  depleted,  and  all  fill  from  vertices  pinned  at  I  to  those  pinned 
at  r  has  been  paid  for.  by  condition  (i).  When  inserting  rn  into  the  separator 
tree,  we  must  pay  for  any  1111  from  vertices  pinned  at  m  to  those  pinned  at 
I  or  r.  Since  all  fill  from  I  to  r  has  already  been  accounted  for,  only  fill  to 
vertices  that  are  internal  to  I  and  cover  m  must  be  considered.  Let  rrd  be  the 
number  of  internal  nodes  that  cover  tn.  I'hen  there  are  at  most  m*{pi  +  p,.) 
Jill  edges  induced  by  the  insertion  of  rn  in  the  elimination  tree.  Lhis  fill  must 
be  paid  for  now.  to  ensure  (i).  since  I  is  depleted  in  F(l,  m)  and  rn  is  depleted 
in  F(rn,r).  Since  p,,*  is  at  least  max  (pi,  pr)/ *2,  the  amount  of  fill  is  at  most 
4rn\pfn.  Applying  Lemma  5  we  know  that  the  potential  decreases  by  at  least 
rn'(rn'  —  1)  +  2yn'(p„*  —  rn*)  +  1  when  inserting  rn  into  the  tree,  and  the  amount 
of  fill  is  at  most  a  constant  times  larger.  ■ 

For  the  last  step  in  the  algorithm,  the  depleted  root  must  be  the  root  with 
largest  ply.  Lhe  following  lemma  makes  sure  that  is  the  case,  by  allowing  us  to 
relabel  them  if  needed. 

Lemma  9  Let  F  be  a  rooted  skeleton  of  an  interval  graph.  Let  I  and  r  be  the 
extremities  of  F,  r  being  depleted.  Then  if  pi  >  pr  the  depleted  status  of  I  and 
r  can  be  exchanged,  without  increasing  the  potential  of  1. 
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Proof.  The  operation  debcribed  in  llie  leiniiia  does  not  aiTecl  the  number  of 
internal  edges.  It  might  decrease  the  number  of  pinned,  non-depleted  edges, 
tlius  eillier  reducing  or  iiot  changing  the  potential.  ■ 

Coming  into  the  halving  procedure,  we  know  that  p,j  was  larger  than  or 
equal  to  mtix{pi./pr).  Now.  since  pm  could  be  larger  than  either  of  those  plies, 
we  don’t  have  that  condition  anymore.  However,  we  can  still  use  the  fact  that 
p.^  >  pf  }/2,  where  I  and  r  are  the  extremities  of  the  interval  graph  being 

considered. 

Lemma  10  (Kill  Sltp)  Let  I  bt  an  inltiTal  gf'aph,  wilh  a  rooUd  sktltlon  path 
P  whose  roots  are  I  and  r,  I  being  depleted  in  1.  Let  pt  >  p,..  and  p,j  >  pr/^^,  for 
all  links  e  in  P.  Then  Kill(l, P.1,7)  finds  k  =  O(logp{)  links  that  when  inserted 
into  the  elimination  tree  m  older,  Jiom  I  to  r,  satisfy  conditions  (i)  and  (Hi) 
while  producing  subgraphs  Ki{ei,  Ct+i)  where  ti  arid  ti+i  aie  non-depleted  loots, 
0  <  i  <  k,  and  also  paying  for  fill  between  vertices  in  P(ei,ei+j)  and  those  in 
P(et,  Ci+i)'-  Ki{ei ,  (which  includes  but  is  not  lestiicted  to  the  fill  desciibed 
in  (a).) 

Proof,  riie  proof  involves  examining  all  possible  sources  of  fill  and  verifying 
that  they  can  all  be  paid  for  with  a  constant  times  the  decrease  in  potential 
caused  by  this  procedure. 

Repeated  applications  of  LeiiunaC  show  that  there  is  no  fill  between  internal 
vertices  in  dilferent  subgraphs,  fhe  links  are  inserted  in  order  from  I  to  r  into 
the  separator  tree,  that  is,  I  and  r  are  already  in  the  tree,  and  then  the  selected 
links  are  inserted  in  order  of  increasing  distance  from  1.  Therefore,  all  fill  is 
between  vertices  pinned  in  consecutive  links  or  to  vertices  pinned  at  /*. 

Let  V  be  a  vertex  that  has  fill  to  r.  Then  v  is  not  pinned  at  r.  Moreover,  if  it 
is  pinned  at  I,  its  fill  to  r  has  already  been  paid  for,  by  condition  (i).  Otherwise, 
V  was  a  vertex  internal  to  I.  and  now  will  occur  in  at  most  2  subgraphs  as  a 
pinned  vertex  (and  be  removed  from  any  subgraphs  whose  skeleton  it  covers 
entirely).  Therefore  v  will  contribute  to  a  decrease  in  potential.  Let  e  be  one 
of  the  selected  links  that  v  covers.  There  are  least  p.j  —  1  edges  to  v  in  /,  which 
are  now  pinned  edges.  Bach  edge  jnight  be  counted  by  at  iriost  2  vertices,  its 
endpoints.  Since  e  is  now  becoming  a  root  it  contributes  one  unit  to  the  decrease 
in  potential,  of  which  v  can  use  up  to  l/p-.  Therefore  v  can  use  some  constant 
times  (pj,.  — 1)/2+ l/p-  to  pay  for  its  fill  to  vertices  pinned  at  r.  Since  p^  >  prfl, 
a  constant  will  suffice. 

The  only  other  source  of  fill  is  to  those  vertices  that  are  removed  from  the 
subgraphs.  When  e,-  and  are  adjacent,  there  is  no  fill  to  be  considered, 
since  all  vertices  in  P(e,.  6,4.1)  are  already  adjacent.  Otherwise,  ti  is  a  sentinel 
and  6,4.1  is  the  Jiext  milestone  (or  r).  Since  neither  6,  nor  e,-4.i  is  depleted  in 
P{ei,ei^i),  this  step  does  not  need  to  pay  for  fill  among  vertices  pinned  at  e,- 
and  those  pinned  at  e,-4i  (see  (i)  and  (ii)).  However,  we  do  need  to  pay  for  fill 
to  vertices  that  are  been  removed  from  the  graph,  and  for  that,  we  will  use  the 


19 


potential  absociated  with  existing  edges  to  those  vertices,  which  are  also  being 
removed. 

rwo  kinds  of  vertices  get  removed  from  the  subgraph  being  defined.  If  a 
vertex  covers  the  whole  skeleton  of  the  subgraph,  it  is  already  adjacent  to  all  its 
vertices,  and  there  is  no  fill  from  within  that  subgraph  to  the  vertex.  Otherwise, 
the  vertex  being  removed  is  pinned  at  1.  and  covers  e< .  Let’s  consider  the  vertices 
in  the  subgraph  P(ei,ti+i)  which  are  not  pinned  at  L  If  they  are  pinned  at  r. 
their  fill  to  vertices  pinned  at  /  has  already  been  paid  for,  since  I  is  depleted 
(from  condition  (i)).  If  on  the  other  hand  they  are  internal  to  i,  they  might 
have  fill  to  the  vertices  that  cover  e<  and  that  are  being  removed  from  the  graph, 
either  because  they  cover  I  or  because  they  cover  both  Cj  and  Cj+i.  A  number 
of  vertices  cover  both  e,  and  1.  but  at  least  half  as  many  vertices  are  pinned  at 
I  and  cover  both  e,  and  and  are  thus  adjacent  to  all  vertices  of 
and  in  particular  to  those  not  pinned  at  either  I  or  e,-.  I'hese  edges  were  internal 
to  I.  and  thus  had  3  units  of  potential  associated  with  each  of  them,  which  can 
be  used  to  pay  for  all  the  fill  to  edges  pinned  at  both  e,  and  L  We  must  make 
sure  that  in  all  other  subgraphs  P(ej.ej^i).  j  ^  i.  each  of  the  edges  that  were 
internal  and  are  helping  us  pay  for  fill  will  not  be  used  to  pay  for  fill.  But  both 
their  endpoints  are  pinned  at  ej  and  thus  they  won’t  be  considered.  ■ 

4.3.2  Bounding  the  amount  of  work 

Unlike  the  accounting  of  fill,  we  must  be  a  bit  more  careful  when  computing 
the  work  required  by  a  given  ordering  since  the  amount  of  work  to  eliminate  a 
vertex  involves  the  square  of  the  number  of  neighbors  the  vertex  has.  We  need 
a  few  lemmas  and  definilions. 

Let  G  =  {V.  P)  be  a  graph,  cv  is  the  size  of  the  largest  clique  of  G  that 
contains  the  vertex  v  €  V .  The  work  involved  in  eliminating  v  from  G  is  given 
by  d  +  1  +  where  d  is  the  degree  of  v  in  G. 

Let  V'  be  the  set  of  internal  vertices  of  G.  and  let  be  the  set  of  pinned, 
noil-depleted  vertices  of  G.  Moreover,  for  each  vertex  v  in  V**  let  be  the 
maximum  among  the  plies  of  the  edges  at  which  v  is  pinned,  and  let  d^,  be 
the  number  of  depleted  vertices  that  cover  that  same  edge  (note  that  there 
are  at  most  two  edges  at  which  a  given  vertex  might  be  pinned.)  Let  u;(ar)  = 
x/2  -f  (x*  —  1)^.  The  wo7‘k  poltnlial  is  defined  as  VV’(G)  =  4  • 

As  the  next  lemma  shows,  W{G)  is  at  most  a  constant 
times  the  minimum  amount  of  work  needed  to  perform  Gaussian  elimination  in 

G. 

Lemma  11  The  lolal  work  iitcesmi'y  o  perjorin  Gausaimi  tliminalion  on  a 
gi-aph  G  is  al  least  W'(G]  = 

Proof,  rhe  base  case,  with  a  single  vertex  is  trivial.  Assume  the  lemma  holds 
for  graphs  with  less  than  k  vertices.  Let  v  be  the  first  vertex  to  be  eliminated 
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iu  a  iiLiiiiinuiii  work  eliiniiialion  of  a  graph  G  with  k  vertices.  Ihe  leiiiiiLa  holds 
for  G  —  {x;}.  Let  d  be  the  degree  of  v  iu  G.  For  each  of  the  neighbors  of  v, 
either  the  largest  clique  it  is  in  has  the  same  size  in  both  and  in  G.  or  it 

decreases  by  at  most  1  when  v  is  removed,  in  which  case  v  must  be  part  of  that 
clique.  Let  w  be  a  neighbor  of  v  in  G  such  that  the  largest  clique  that  contains 
w  in  G  —  {(/•}  has  size  x*.  while  the  largest  clique  containiiLg  w  in  G  has  size 
X'  +  1,  Then  a;  contributes  an  extra  1/2  -f  (x*^  -  (x  —  l)^)/3  =  1/2  +  (2  •  x*  —  l)/3 
when  comparing  W*(G)  and  W*[G'),  But  x*  <  d  so  that  the  contributions  of 
all  neighbors  of  v  to  W'(G)  add  up  to  at  most  d/2  +  d  ■  (2  •  d  —  l)/3.  v’s  own 
contribution  is  at  most  (d  +  l)/2  +  d^/3,  so  that  W\G)  —  W'{G*)  <  d  +  1  +  d^. 

By  induction,  the  amount  of  work  necessary  to  perform  Gaussian  elimination 
in  G  is  at  least  W\G*)  plus  d  +  1  +  d^.  the  amount  of  work  to  eliminate  v.  and 
thus  at  least  W^{G).  ■ 

Lemma  12  Ltl  Pil./r)  be  an  interval  (J7’aph,  with  skeleton  F,  and  roots  I  and 
r,  I  being  depleted.  Let  m  be  an  edge  of  F,  distinct  Jivm  I  and  r.  if  I  is 
depleted  in  F(l.  m)  and  m  is  depleted  in  F{tn.  r)  then  W(F(l,  r))—(W(F(l.  ’m))-!- 
yV{F{m.  r)))  >  ni'  '  w(pfn),  where  m'  is  the  number  of  vertices  inter  nal  to  F(l,  r) 
which  cover  rn. 

Proof.  Depleted  vertices  do  not  contribute  to  the  work  potential,  and  all  ver¬ 
tices  which  are  depleted  in  F(l.  r)  are  depleted  in  F(l,  tn),  If  such  a  vertex  is 
also  in  P(m.  r).  then  it  must  cover  m.  and  is  depleted  in  jP(m.  r). 

Let  V  be  a  vertex  which  is  internal  to  F{l.jn).  Since  v  is  not  adjacent  to 
any  vertices  which  are  not  in  F{l,  tn).  and  F(l.  fn)  is  an  induced  subgraph  of 
F{l,/r].  the  largest  clique  v  is  in  F(L  r)  and  F(l,  rn)  must  have  the  same  size. 
Vertices  which  are  internal  to  F{fn,  r)  are  analogous.  Therefore,  vertices  internal 
to  either  P(L  m)  or  F{m,  r)  do  not  contribute  towards  the  dillerence  in  work 
potential. 

File  dilference  in  potential  is  associated  with  the  vertices  which  are  pinned 
at  r  and  were  not  depleted  in  F{l.r)  and  with  those  m'  vertices  that  used  to 
be  internal,  and  are  now  depleted  in  F{tn,  r)  and  pinned  (but  not  depleted)  in 
F(l./m).  Let  F  be  the  number  of  vertices  pinned  at  r  and  that  are  not  depleted 
in  F(m,  r),  and  let  /*,„  be  the  number  of  vertices  pinned  at  both  r  and  m,  but 
not  at  1.  Vertices  pinned  at  m  do  not  contribute  to  the  potential  of  F(m,  r), 
Fhere  are  exactly  /rt'-f  /'m  vertices  that  cover  m  and  are  not  depleted  in  F{1.  rn) 
thus  contributing  (rn*  +  +  r„t)/2  -H  {rn'  +  —  1)^)  to  the  potential  of 

F(l,rn),  Those  same  rn'  vertices  used  to  be  internal  to  jP (/.  /')  and  were  in  a 
clique  of  size  at  least  p„i.  thus  adding  at  least  4  •  rn'  •  (Pfft/2  -H  (pf^  —  1)^)  to  the 
potential  of  F(l,  r).  Finally,  the  /  m  +  vertices  which  were  pinned  at  r  but  not 
depleted  in  F{1.  /•)  contribute  (r„*  -f  r0((OM  +  'r')/2  +  {vm+  F  —  1)^)  to  the  work 
potential  of  F(l,  r).  but  only  contribute  F{F/2-{-  (F  —  1)^)  to  the  potential  of 
F{rn,  /')  (and  have  already  been  accounted  for  in  their  contribution  towards  the 
potential  of  F{l.  rn)  as  vertices  pinned  at  m  and  not  at  /),  Thus  we  have 
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W(P(l,  r))  -  {W(P{1..  J«))  +  W{F{m.,  r))  > 

4  •  m'  •  w(p„J  +  (r„.  +  ■/)  ■  w(r,„  +  /•')  -  ((m'  +  /•„,)  •  u:{'fn'  +  /■„,)  +  v'  ■  w{r')) 

Tlie  leiiiiiia  can  be  proved  by  bliovviiig  by  sublracliiig  rn'  •  w(pm)  from  the 
quantity  above,  and  sliowing  it  is  greater  than  or  equal  to  0.  Since  ’p,n  >  + 

we  have: 


3  •  m'  •  w{p„t)  +  (r„i  +  ■/)  •  +  /)  -  ((m*  +  r,„)  •  ’w(m'  +  rm)  +  r'  •  u;(r')) 

3  •  rn*  •  +  m')  +  (r,,*  +  /•')  •  2(/>„  +  /*')  -  ((/«'  +  r,„)  ■  w(m*  +  r,„)  +  r'  •  'u;(r')) 

(3o„  •  -  3/2  •  rm  •  rn')  +  (2/^/^  +  2/n'  -  3m'^)  +  3rf^,  •  r'  +  (3/v,i  •  -  3r„*  •  /) 

But  if -m'  >  0  we  have  3r„4  •  --  3/2  •  r,n  •  m'  >  0.  as  well  as  2y«'^  +  2m'  — 

37n'^  >  t)  (equals  U  for  m'  =  0;  equals  1  for  m'  =  1  and  is  at  least  m'^  for 
>  2)*  Finally,  for  /  '  >  0  we  can  also  verify  that  3rf,t  •  —  3/'/,*  ■  r'  >  0,  thus 

concluding  the  proof.  ■ 

The  next  lemma  allows  us  to  pay  for  work  in  parts.  All  it  really  says  is 
that  as  long  as  we  have  at  most  a  constant  number,  in  this  case  3.  of  parts 
that  can  be  paid  for  separately,  then  all  of  them  taken  together  can  also  be 
paid  for.  by  increasing  a  bit  the  constants  involved  in  the  0{)  notation.  Let 

Lemma  13  Ltl  G  ht  a  gitiph,  and  'o  be  a  vertex  of  G.  If  v  has  neighboi's  in  at 
most  3  sets  of  vertices  Vi,  V2  and  V3  by  the  time  v  is  to  be  eliminated  from  G, 
then  the  work  involved  in  eliminating  v  from  G  is  where  x  =  |ki  U  l/gU  14| 

which  wO(3'(|l/i|)  +  3'(|l/2|)  +  3'(|l/3|))- 

Proof.  Follows  from  the  fact  that  |ki  U  l/g  U  V3I  is  at  most  3  times  the  maximum 

of  |Fi|.  IF2I  iFsl-  ■ 

A  vertex  is  said  to  be  unive7sal  in  G  if  it  is  adjacent  to  all  vertices  of  G.  Let 
W-„(G)  be  the  work  involved  in  performing  Gaussian  elimination  on  the  graph 
G.  according  to  the  ordering  o.  Let  W’'{G)  be  the  minimum  over  all  orderings 
TT  of  Wrr(G),  i.e..  the  work  incurred  by  a  minimum  work  ordering. 

We  can  now  show  that  the  total  amount  of  work  required  by  the  ordering 
provided  for  our  algorithms  for  both  interval  and  chordal  graphs  is  linear  in  the 
minimum  amount  of  work  necessary. 

Lemma  14  The  total  amount  of  woik  required  to  perfoim  Gaussian  elimination 
on  an  intei'val  graph  I  according  to  an  ordering  generated  by  our  algorithm  is 

o(w-{n). 

Proof.  We  shall  use  the  decrease  in  potential  to  pay  for  work  involved  in 
eliminating  sets  of  vertices.  In  each  phase,  let  F(l.  r)  be  the  subgraph  under 
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consideration.  Subgraplis  without  any  internal  vertices  constitute  the  base  case 
for  the  recursion,  and  are  trivial  to  analyze.  Internal  vertices  of  jP(/.  r)  only 
affect  differences  in  potential  between  F(l.  r)  and  the  new  subgraphs  created  by 
a  phase  if  they  become  pinned. 

Consider  the  homogenizing  phase:  without  loss  of  generality,  assume  pi  >  pr, 
rhe  total  number  of  vertices  that  are  not  internal  after  the  end  of  this  phase  is 
at  most  the  sum  of  the  plies  of  the  selected  edges,  and  thus  less  than  x  =  4  -  pi . 
Vertices  which  are  internal  to  any  one  of  the  subgraphs  defined  by  this  phase 
are  to  be  eliminated  before  the  vertices  that  are  pinned  by  the  end  of  this  phase, 
rherefore  the  work  involved  in  eliminating  any  one  of  these  pinned  vertices  is 
at  most  X  +  (a<‘  —  1)^.  not  more  than  a  constant  times  w(pi).  The  decrease  in 
potential  is  in  fact  at  least  u;(pf)  siiice  I  became  depleted  in  this  phase  and 
pinning  the  other  vertices  does  not  increase  the  poteiitial. 

Let’s  consider  the  halving  phase:  in  the  homogenizing  phase  we  have  already 
accounted  for  the  work  to  eliminate  the  vertices  which  are  already  pinned,  so 
that  we  only  have  to  account  for  those  that  cover  the  newly  selected  edge,  rn, 
and  do  not  cover  either  /  or  r.  Let  m'  be  the  number  of  such  vertices.  They  will 
have  edges  to  the  vertices  pinned  at  both  I  and  r. 

By  Lemma  12,  the  difference  in  potential  between  F{1.  /*)  and  the  sum  of  the 
potentials  of  and  F(m,r)  is  at  least  •  w(pm).  We  need  to  pay  for  at 

most  m'  •  (y  +  (:y  —  1)^)  where  y  <  d*  p/  +  Pr  •  Since  p„t  >  inax(pi,  Pr)/2.  we 
can  pay  for  this  work  with  a  constant  times  the  decrease  in  potential. 

Next,  we  must  make  sure  that  the  work  potential  does  not  increase  when 
switching  the  depleted  and  non-depleted  roots  of  a  skeleton  so  that  we  make  the 
root  with  the  largest  ply  the  depleted  one.  But  this  follows  from  the  definition 
of  the  potential  function. 

Finally,  we  consider  the  kill  phase.  T  he  work  involved  in  eliminating  vertices 
pinned  at  /  or  r  has  already  been  accounted  for.  and  we  need  to  account  for  the 
work  involved  in  eliminating  the  vertices  that  are  pinned  in  this  phase. 

Assume  /  is  the  depleted  root.  Let  v  be  a  vertex  that  gets  pinned  at  an  edge 
ti  in  the  kill  phase,  v  will  have  edges  to  vertices  pinned  at  the  edge  e,_i  by  the 
time  it  is  to  be  eliminated  (where  the  e^’s  are  the  edges  which  were  selected  in 
the  kill  phase,  as  described  in  the  algorithm),  v  can  also  have  edges  to  vertices 
pinned  at  r.  Lemma  13  tells  us  we  can  pay  for  each  part  separately.  Work 
associated  with  vertices  pinned  at  e,_i  will  be  accounted  for  in  the  recursive 
call.  V  can  pay  for  work  associated  with  r  since  pc,  '>  Pr/'2  and  the  decrease  in 
potential  associated  with  its  own  pinning  is  at  least  pt‘,/2  +  (p,.,  —  1)^. 

Finally  we  have  to  make  sure  it  is  ok  to  simply  remove  vertices  from  the 
subgraphs  F{ti,ti^i)  and  recurse  on  To  verify  that,  we  observe 

that  at  no  other  point  in  the  algorithm  we  change  the  potential  of  vertices 
which  are  not  pinned.  If  we  add  all  these  changes  over  the  various  recursive 
steps  of  the  algorithm,  we  can  actually  use  w{ct,)  as  t;’s  contribution  towards 
the  potential,  where  cv  is  the  size  of  the  largest  clique  v  is  in  i,  instead  of 
considering  the  size  of  the  largest  clique  v  is  in  the  subgraph  being  handled. 
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Consider  all  vertices  tliat  v  is  adjacent  to  in  the  updated  graph  by  the  time  it 
is  to  be  eliminated.  We  have  accounted  for  the  work  involved  in  t/’s  elimination 
due  to  all  vertices  but  tliose  that  were  removed  in  various  kill  pliases.  Let  y  be 
the  number  of  sucli  vertices.  At  least  half  of  them  were  adjacent  to  o  and  to 
themselves.  The  work  due  to  v’s  elimination  associated  with  these  y  vertices  is 
at  most  a  constant  times  since  cv  >  ;(//2+  1.  Lemma  13  allows  us  to  pay 

separately  for  this  “part”  of  the  work.  ■ 

5  Chordal  graphs 

In  this  section  we  show  how  to  find  an  elimination  ordering  for  a  cliordal  graph 
G  by  repeatedly  applying  one  of  the  interval  graph  algorithms  we’ve  already 
described  to  branches  of  G’s  skeleton.  This  tree-contraction  like  approach  was 
also  used  by  Naor.  Naor  and  SclialTer  [20]  when  developing  algorithms  for  chordal 
graphs. 

Consider  a  chordal  grapli  G.  and  its  skeleton  tree  7  .  I’he  algorithm  in 
Section  3  or  the  algorithm  in  Section  4  can  be  used,  so  that  we  obtain  two 
chordal  graph  algorithms  that  work  by  finding  terminal  branches  of  the  skeleton 
7  .  and  applying  the  interval  graph  algorithm  to  the  branches.  All  pre-existing 
terminal  branches  can  be  processed  in  parallel,  and  by  re-iterating  tliis  process 
we  completely  examine  the  tree  in  0(log7i)  steps. 

The  actual  algoritlim  that  is  to  be  applied  to  the  path  P{1.  r)  is  essentially 
the  Kill  algorithm.  I'lie  only  dillereuces  are  that  r  is  not  a  root,  and  we  do 
not  have  any  sort  of  bounds  on  the  plies  of  the  links  in  the  skeleton  path.  This 
algorithm  will  divide  P(L,  r)  in  a  number  of  subgraphs,  that  will  then  be  used 
as  input  to  our  favorite  interval  graph  algorithm. 

We  add  an  imaginary  link  P  to  the  skeleton  of  F{l,  r).  so  that  P  is  now 
the  last  link  of  the  skeleton,  as  opposed  to  r.  Call  r'  a  root.  Since  pj.  =  0, 
the  ply  conditions  in  Lemma  10  are  trivially  satisfied,  and  we  can  apply  the 
Kill  algorithm  to  partition  P{L  r)  in  rooted  subgraphs,  with  no  depleted  roots. 
P{L,  r)  does  not  include  any  single-vertex  sub-trees  that  might  be  present  in  the 
chordal  graph,  riiese  should  be  eliminated  before  any  of  the  otlier  vertices  of 
P[L  r).  thus  not  introducing  any  fill. 

Given  a  graph  G,  with  n  vertices  and  m  edges,  and  whose  largest  clique  has 
size  C.  we  can  show  the  following  results. 

•  T'he  chordal  version  of  the  nested  dissection  algorithm  (Section  3)  produces 
an  ordering  with  0{C  •  log*^  u)  height  and  0(m\/\og  n)  fill. 

•  I'he  chordal  version  of  our  linear  fill  algorithm  (Section  4)  produces  an 
ordering  with  0(C’ -log^yi)  height,  0(m)  fill,  and  0{W’' [G))  work,  where 
W’‘  (G)  is  the  minimum  amount  of  work,  over  all  possible  orderings  for  G. 

The  lemmas  presented  here  allow  us  to  extend  the  fill  analysis  to  the  chordal 
version  of  our  algorithms. 
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Lemma  15  Let  G  ht  a  chordal  graph  with  a  sktltlon  Irtt  T.  Ltl  r  be  a  link 
to  a  leaf  oJT,  and  I  be  the  other  extremity  of  the  terminal  branch  ofT  which 
includes  r.  Let  I  be  a  depleted  root  in  FiL/r)  and  let  G'  be  the  graph  obtained 
from  G  by  removing  all  vertices  of  G  which  are  internal  to  F(l,  r).  Then  the 
potential  ^(G)  =  ^[G*]  +  <i>{F{l,  r))  +  1. 

Proof,  I’lie  only  vertices  lliat  sliow  up  in  both  G'  and  P(l.  r)  are  those  which 
cover  1.  Since  tliey  are  depleted  in  F(L  r),  any  edges  between  them  are  only 
counted  towards  the  potential  hi  G^  All  otlier  edges  of  G  are  internal  to  either 
G'  or  P(Lr).  but  not  both.  As  for  the  links,  they  only  show  up  in  either  G' 
or  P(l.  r).  but  I  is  depleted  in  P{l.  r).  and  tlierefore  doesn’t  contribute  towards 
P{l.r).  '  m 

Let  G.  G'  and  P(l,  r)  be  as  described  in  Lemma  15. 

Lemma  16  If  I  is  the  only  root  in  P(l.  r),  then  any  ordering  for  the  remaining 
vertices  of  P{1.  r)  does  not  induce  any  fdl  in  G  to  vertices  of  G  —  P{1,  r). 

Proof.  As  long  as  I  is  the  only  root  in  P(l,  r),  the  nodes  that  cover  I  must  be 
eliminated  after  all  other  vertices  of  P{1,  r)  are.  Let  v  be  any  vertex  in  P{1,  r) 
that  does  not  cover  /,  and  let  w  be  a  vertex  of  G  “  P(l.  r).  Any  path  from  t;  to 
w  must  go  tlirough  a  vertex  that  covers  1.  and  is  thus  later  in  the  elimination 
ordering  than  w.  riierefore,  there  can’t  be  fill  between  v  and  w.  ■ 

Lemma  17  The  chordal  graph  version  of  the  linear  fdl  algorithm  from  Section 
4  also  has  linear  work. 

Proof.  The  work  potential  of  a  chordal  graph  is  no  smaller  than  the  work 
potential  of  the  graph  obtained  by  removing  one  of  its  terminal  branches  added 
to  the  potential  of  the  terminal  branch  itself,  if  the  edge  that  used  to  connect  the 
branch  to  the  skeleton  of  the  graph  is  a  depleted  root.  Lhis  follows  since  except 
for  the  vertices  that  are  depleted,  no  other  vertex  appears  in  both  subgraphs. 
Since  the  first  step  of  the  chordal  graph  algorithm  is  identical  to  a  kill  operation, 
in  which  one  of  the  roots  has  ply  U.  the  result  follows  from  the  proof  of  Lemma 
14.  ■ 

6  Experimental  results 

We  implemented  the  chordal  graph  version  of  the  algorithm  presented  in  Sec¬ 
tion  5.  In  this  section  we  present  some  of  the  results  we  have  obtained. 

The  bcsstk  matrices  used  in  our  experiments  come  from  structural  engineer¬ 
ing  problems,  and  were  obtained  from  the  Harwell- Boeing  collection,  and  from 
Timothy  Davis’s  “University  of  Florida  Sparse  Matrix  Collection”  (the  matri¬ 
ces  were  provided  to  Davis  by  Roger  Grimes,  at  Boeing.)  The  nasasrb  matrix 
models  the  structure  from  the  NASA  Langley  shuttle  rocket  booster,  and  the 
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Matrix 

1  Vertices  j 

Edges 

bcsstk30 

1007284 

bc35tk31 

572914 

bcsstk32 

44609 

985046 

bcsstk35 

30237 

bcsstk36 

560044 

bcsstk37 

WESSSSi 

557737 

nasasrb 

54870 

G256x256 

65536 

130560 

064x1021 

65536 

129984 

016x4096 

65536 

126960 

lable  1:  Number  of  vertices  and  edges  in  the  original  input  graphs 


Gh  X  w  matrices  are  h  x  w  grids.  The  number  of  vertices  and  edges  in  eacli  of 
the  corresponding  graphs  can  be  found  in  Table  1. 


Matrix 

Non- zeros 

1  Height 

AMD 

Post 

AMD 

METIS 

Post 

METIS 

AMD 

Post 

AMD 

METIS 

Post 

METIS 

bcsstk30 

3853728 

4253498 

4952030 

4880401 

2764 

2127 

1305 

1305 

bcsstk31 

5557200 

5911019 

5125629 

mmm 

1428 

1424 

bcsstk32 

5142573 

6817977 

6752219 

BOSS 

BSZI 

1682 

1659 

l)csstlc35 

2732030 

3901153 

1192 

1192 

bcsstk36 

2732511 

3647743 

1435 

1348 

1348 

bcsstk37 

2799200 

3647122 

1259 

1251 

nasasrb 

11953582 

■ssm 

11752835 

KSB 

1874 

1874 

0256x256 

1971395 

1995992 

2238191 

2234147 

■JiOl 

806 

804 

064x1024 

1425433 

1703195 

1750885 

1748006 

■oo 

■03 

■■Ql 

464 

016x4096 

656963 

968911 

986596 

984855 

1^01 

380 

185 

182 

Table  2:  Results  obtained  by  post- pro  cessing  good  existing  orderings 

VVe  chose  to  compare  our  algorithm  to  a  version  of  the  approximate  minimum- 
degree  heuristic  (AMD)  [8]  and  to  ME'TIS  [17].  which  produces  nested  dis¬ 
section  orderings.  Table  2  show  the  results  obtained  when  using  our  chordal 
graph  algorithm  as  a  post- processing  phase  to  either  AMD  (code  obtained  from 
ftp://ftp,cise. ull.edu/pub/umfpack/AMD/  )  or  METIS  (code  obtained  from 
ftp://ftp.cs.umn.edu/dept/users/kumar/metis/  ).  The  number  of  non-zeros 
presented  in  the  table  includes  entries  that  are  in  the  original,  not  necessarily 
chordal,  graph,  well  as  any  fill  entries.  Given  the  filial  updated  graph  obtained 
from  a  given  ordering,  we  measured  the  total  number  of  non-zeros  above  and 


including  the  diagonal.  The  height  entries  in  Table  2  correspond  to  that  of  a 
minimuiii height  ordering  that  is  consistent  witli  the  ordering  produced,  that  is. 
a  iiiiniinum  height  ordering  wliose  updated  graph  is  identical  to  that  induced 
by  the  corresponding  ordering.  Given  a  chordal  completion,  such  a  minimum 
height  ordering,  and  its  lieight  can  be  easily  computed  [25]. 

Our  results  indicate  that  our  algorithm  usually  produces  an  ordering  that  lias 
a  small  amount  of  extra  fill  when  compared  to  the  chordal  completion  it  starts 
with.  Ill  some  cases,  our  post- processing  actually  produces  small  improvements 
on  the  number  of  non-zeros.  Contrary  to  what  we  expected,  for  most  graphs, 
the  AMD  orderings  were  very  parallel,  thus  making  it  harder  for  us  to  obtain 
significant  improvements  in  height.  It  is  interesting  to  notice  that  for  grids  with 
large  aspect  ratio  the  AMD  orderings  cannot  be  directly  parallelized.  In  those 
test  cases,  our  orderings  produce  a  slightly  lower  number  of  non-zero  entries  than 
the  nested  dissection  orderings,  and  a  small  constant  higher  than  the  number 
of  non-zeros  incurred  by  the  AMD  orderings.  In  these  cases,  the  orderings 
our  algorithm  produced  are  significantly  more  parallel  then  the  original  AMD 
orderings,  and  only  slightly  worse  than  the  nested  dissection  ones. 

fhe  work,  that  in,  number  of  lloating- point  operations  for  each  of  these 
orderings  can  be  found  in  the  appendi.x  in  Table  3,  As  we  can  see,  the  amount 
of  work  for  each  ordering  is  highly  correlated  with  the  number  of  non-zeros  it 
induces. 


Work  1 

AMD 

Post 

AMD 

METIS 

Post 

METIS 

bcsstk30 

9.416e-}-08 

1.3026+09 

1.4886+09 

1.466e+09 

bcsstkTl 

2.8986+09 

3.5196+09 

1.633e+09 

1.622e+09 

bcsstk32 

9.479e+08 

1.036e+09 

2.0856+09 

2.066e+09 

bcs3tk35 

3.832e+08 

4.3656+08 

9.785e+08 

9.617e+08 

bcsstk36 

6.201e+08 

6.481e+08 

1.212e+09 

1.206e+09 

bcsstk37 

5.322e+08 

6.0216+08 

1.0416+09 

1.0346+09 

nasasrb 

4.771e+09 

8.0446+09 

4.803e+09 

4.7876+09 

0256x256 

2.607e+08 

2.7616+08 

3.1286+08 

3.1266+08 

064x1024 

8.470e+07 

1.651e+08 

1.3256+08 

1.3286+08 

016x4096 

8.507e+06 

2.653e+07 

2.469e+07 

2.4706+07 

Table  3:  Work  results  obtained  by  post-processing  good  existing  orderings 


7  Concluding  remarks 

A  number  of  interesting  questions  remain  open: 
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Can  we  prove  any  bounds  on  the  performance  of  the  minimum-degree  heuris¬ 
tic  on  cliordal  or  even  interval  graphs? 

Are  there  algorithms  that  produce  parallel  orderings  whose  fill  is  within  a 
constant  factor  of  optimal,  for  general  graphs? 

Can  we  incorporate  the  idea  of  sentinels  into  other  heuristics,  such  as  minimum- 
degree  and  nested  dissection?  If  so.  what  bounds  can  be  proved  on  the  fill  and 
work  of  these  algorithms? 
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